Contractive Markov Systems
نویسنده
چکیده
Certain discrete-time Markov processes on locally compact metric spaces which arise from graphdirected constructions of fractal sets with place-dependent probabilities are studied. Such systems naturally extend finite Markov chains and inherit some of their properties. It is shown that the Markov operator defined by such a system has a unique invariant probability measure in the irreducible case and an attractive probability measure in the aperiodic case if the vertex sets form an open partition of the state space, the restrictions of the probability functions on their vertex sets are Dini-continuous and bounded away from zero, and the system satisfies a condition of contractiveness on average.
منابع مشابه
Somewhat Stochastic Matrices
The notion of a Markov chain is ubiquitous in linear algebra and probability books. In linear algebra a Markov chain is a sequence {xk} of vectors defined recursively by a specified vector x0, a square matrix P and the recursion xk = Pxk−1 for k = 1, 2, . . .. That is, xk = P x0. Natural probabilistic restrictions are imposed on x0 and P . It is assumed that x0 is a probability vector; that is,...
متن کاملQuasi-contractive Mappings in Fuzzy Metric Spaces
We consider the concept of fuzzy quasi-contractions initiated by '{C}iri'{c} in the setting of fuzzy metric spaces and establish fixed point theorems for quasi-contractive mappings and for fuzzy $mathcal{H}$-contractive mappings on M-complete fuzzy metric spaces in the sense of George and Veeramani.The results are illustrated by a representative example.
متن کاملA fuzzy treatment of uncertain Markov decision processes: Average case
In this paper, the uncertain transition matrices for inhomogeneous Markov decision processes are described by use of fuzzy sets. Introducing a ν-step contractive property, called a minorization condition, for the average case, we fined a Pareto optimal policy maximizing the average expected fuzzy rewards under some partial order. The Pareto optimal policies are characterized by maximal solution...
متن کاملReliability analysis of repairable systems using system dynamics modeling and simulation
Repairable standby system’s study and analysis is an important topic in reliability. Analytical techniques become very complicated and unrealistic especially for modern complex systems. There have been attempts in the literature to evolve more realistic techniques using simulation approach for reliability analysis of systems. This paper proposes a hybrid approach called as Markov system ...
متن کاملOn some properties of contracting matrices
The concepts of paracontracting, pseudocontracting and nonexpanding operators have been shown to be useful in proving convergence of asynchronous or parallel iteration algorithms. The purpose of this paper is to give characterizations of these operators when they are linear and finite-dimensional. First we show that pseudocontractivity of stochastic matrices with respect to ‖ · ‖∞ is equivalent...
متن کامل